Experiment 3 Pilot Analysis (round 2)

This document was last updated at 2019-08-09 15:38:13.

This document is dedicated to conducting a descriptive summary of the survey data from the Experiment 3 pilot. Briefly, this pilot was conducted mostly to assess the clarity of instructions. Twenty five subjects were recruited for the pilot. This is the second round of piloting, where the stimuli have been simplified such that we are no longer displaying the absolute effort units. The stimuli now look like the following:

And the instructional video was modified to be the following:

The survey that was given to subjects (which is the same as the last round of piloting) can be seen below:

d <- read.csv('../../data/demo.csv')

d$clarity <- factor(d$clarity, levels = rev(c('very-clear', 'somewhat-clear', 'neutral', 'somewhat-unclear', 'very-unclear')))
d$unitFeel <- factor(d$unitFeel, levels = c('no-relationship', 'weak', 'moderate', 'strong'))
d %>% 
  group_by(clarity) %>% 
  summarize(Count = n()) %>% 
  mutate(Relative.Proportion = Count / sum(Count))

ggplot(d, aes(x = clarity)) +
  geom_histogram(stat = 'count', fill = 'light grey', color = 'black') +
  scale_x_discrete(drop = FALSE, labels = c(`very-clear` = 'Very Clear', `somewhat-clear` = 'Somewhat Clear', `neutral` = 'Neutral', `somewhat-unclear` = 'Somewhat Unclear', `very-unclear` = 'Very Unclear')) +
  labs(
    x = 'Clarity', 
    y = 'Count'
  ) + 
  theme_bw()

d %>% 
  group_by(unitFeel) %>% 
  summarize(Count = n()) %>% 
  mutate(Relative.Proportion = Count / sum(Count))

ggplot(d, aes(x = unitFeel)) +
  geom_histogram(stat = 'count', fill = 'light grey', color = 'black') +
  scale_x_discrete(drop = FALSE, labels = c(`no-relationship` = 'No Relationship', `weak` = 'Weak', `moderate` = 'Moderate', `strong` = 'Strong')) +
  labs(
    x = 'Feel of Units Tied to Difficulty', 
    y = 'Count'
  ) + 
  theme_bw()

for (row in 1:(nrow(d))) {
  print(paste('Subject ', row, ':', sep=''))
  print(toString(d[row,]$comments))
  print('')
}

## [1] "Subject 1:"
## [1] "none"
## [1] ""
## [1] "Subject 2:"
## [1] "Once I got the hang of it, things were kind of fun."
## [1] ""
## [1] "Subject 3:"
## [1] "it was very clear"
## [1] ""
## [1] "Subject 4:"
## [1] "No Issues."
## [1] ""
## [1] "Subject 5:"
## [1] "NOTHING REALLY"
## [1] ""
## [1] "Subject 6:"
## [1] "No comment, I don't feel really one way or another. "
## [1] ""
## [1] "Subject 7:"
## [1] "nothing"
## [1] ""
## [1] "Subject 8:"
## [1] "I think everything made sense pretty well. I like the video tutorial of it. That was helpful in knowing how the format was going to be."
## [1] ""
## [1] "Subject 9:"
## [1] "the second video could have been explained in a more simplistic way"
## [1] ""
## [1] "Subject 10:"
## [1] "I was just hope I did this correctly. It was hard to concentrate on hitting the correct letter but interesting and fun."
## [1] ""
## [1] "Subject 11:"
## [1] "It was explained well."
## [1] ""
## [1] "Subject 12:"
## [1] "I think the second portion was a bit confusing on the keyboard."
## [1] ""
## [1] "Subject 13:"
## [1] "N/A"
## [1] ""
## [1] "Subject 14:"
## [1] "It was clear and also enjoyable"
## [1] ""
## [1] "Subject 15:"
## [1] "It was clear just a bit difficult switching back and forth in my brain."
## [1] ""
## [1] "Subject 16:"
## [1] "Nothing comes to mind."
## [1] ""
## [1] "Subject 17:"
## [1] "didnt' seem unclear.. justs remembering rules was hard at times"
## [1] ""
## [1] "Subject 18:"
## [1] "i was describe clear and perfect"
## [1] ""
## [1] "Subject 19:"
## [1] "i was described very clear and perfect"
## [1] ""
## [1] "Subject 20:"
## [1] "It was explained very clearly. My brain just had to really think. Thank you very much."
## [1] ""
## [1] "Subject 21:"
## [1] "nothing"
## [1] ""
## [1] "Subject 22:"
## [1] "I thought everything was explained well."
## [1] ""
## [1] "Subject 23:"
## [1] "The video explained it well"
## [1] ""
## [1] "Subject 24:"
## [1] "the task was very clear ."
## [1] ""
## [1] "Subject 25:"
## [1] "I didn't get what they meant by switch at first. I thought they meant they were going to switch what the two colors represented."
## [1] ""

Analysis Homepage

A work by Dave Braun

dab414@lehigh.edu